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A. OFERATIONAL SETTING 


The employment ci fast patrol boats) {2Ps"s) jet Sike 
Federal German Navy in operations in the Baltic creates a 
special vigilance proklem. Due to limitations in accomoda- 
tion space, the boats have a small complement of men, just 
sufficient in number to man battle stations, but excluding 
any watch shifts. A normal operation, preceded by reprlenish- 
ment of ammunitions, water, and fuel, maintenance work, and 
tactical briefings during daylight, commences after sunset 
and is ccmpleted or terminated before dawn. Even in the age 
of sophisticated wearfon and surveillance systems, the dark 
still prevides the best cover against the FPB's most feared 
predator, the aircraft. But it 1S just thatstime intervaw 
which arcuses major concern about the performance of radar 
operators. The introduction of an up-to-date combat infcrna- 
tion system has eased the operators! surveillance task, Lut 
there are still questions about intolerable decrements in 
Operator vigilance, which is crucial through the whcle 
length of a mission, especially under the expecticn of 
comparably low signal density for sea surveillance in the 


Faltic in time of tension or armed conflict. 


Be. TECHNICAL BACKGRCUND 


Since the FPB's ccmbat information system is designed to 
allow the ircorporaticn of user-originated software changes, 
attention has focused on improvements in that sector. Most 
likely, the eventual results will be, in human factecrs 
vocabulary, changes in signal display, more specificly, in 


it CLla tio nmece dana Other environmental improvements to 
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enhance cperator performance are infeasible in view of the 
limited ¢pace and other restrictions typical for a naval 
vessel. Such a set cf conditions reguires further research 
to gain insight intc the several possibilities of improve- 
ment which are available. The one chosen aS a fromising 
alternative was the addition of redundant colour to the 
Shape coding mechanism already in use in the tactical 
display. It is the goal of this study to determine whether 
the expenditure of the considerable costs of implementing 
such a change can be justified. 

The following review covers relevant findings in beth 
vigilance and signal theory to establish a more thorough 


understanding for this combination. 
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A. VIGILANCE 


1. Circadian Rhythm and Correlates 


Vigilance has been a major concern of human factors 
studies in the past and present. FOr OUr Special case, jag 


eight hours sustained operation, it has been found that 


wu 6 eee)6€ €6WWAlthl6 66©ca Few.) [notable exceptions, evigilance 
researchers simply have not attempted £o measure what- 
ever performance decrements may occur during such time 
frame." [Ref. 13 p. 49]. 


All those who make the attempt have to deal with the phencn- 
enon of circadian or diurnal rhythm. Coates [Ref£. 2] states 
that the extent of performance decrement in sustained ofera- 
tions depends on the simultaneous phase of circadian rhythn. 
More specifically, we derive from his results that a ofemas 
tional phase from dusk to dawn coincides with a worst case 
decrement in vigilance rerformance of nearly 35 4. The few 
existing investigaticns of real world performance in the 
same time frame are even more specific showing a performance 
‘low’ in terms of number of errors at 3 a.m. { Ref. 3] and 
from midnight to 6 a.n. {Ref. 4], respectively. A field 
study on vigilance during prolonged night driving [Ref. 5] 
concurs with these results. Furthermore, the experimenters 
conclude that the decrement found in their case was not only 
caused Ey previous daily work, but by its combination with 
declining diurnal rhythn, monotonous task, and lack of 
Sleep, all these contributing to a marked deterioraticn of 
perfcrmance even under confrontation with personal danger. 


We could hardly find a situation more apt to comparison with 
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the present experimert. The experiments of C'Hanlon and 
Kelley [Ref. 6], Klein [{Ref. 7], MicGmeloulton {| Rer. 8 | 
confirm the concern about loss of vigilance in spite of 
grave personal conseguences of inattention, even in reccg- 
nized emergencies. 

Cne must exercise caution, however, in assuming an 
external validity of these results for this test setting, 
because all of the. studies mentioned above are field e~re ial 
ments and used a relatively more complex task , ¢€.g. the 
driving of a motor vehicle, instead of monitoring. 

The important aspect of visual fatigue can only be 
menticned, emphasizirg that there are no results showing a 
definite correlation retween that phenomenon and degradation 


in perfcrmance [Ref. 9]. 
2. Signal Detection Theory ( ISD ) 


A major question in vigilance research remains 
whether the theory cf signal detection is generally appli- 
cable or not. It seems to be especially applicable tca 
monitoring task invclving both decision and discrimination 
[Ref. 1]. Some more specific remarks are, however, neces- 
sary. An in-depth literature review by Swets [Ref. 10} 
points out that there is evidence that the normally cbserved 
increase in the cbserver's decision criterion did not occur 
in experiments in which Signal occurrences were as frokakle 
as Or more probable than background events. A contemporary 
experiment by Vickers [Ref. 11] shows that criterion to be 
dependent on the difference between a ‘local' and a curula- 
tive signal probability established by the observer. 
Teichner [Ref. 12], a major critic, states that the assump- 
tion of a subjects' change of the decision criterion kLased 
on an acguired knowledge of signal probability is unlikely 
to occur within an experiment. For the case of a very low 


foc but high irregularity of signals, even with an 


13 


underlying constant signal probability, those cbserved 
effects are likely to cccur, but very difficult to observe. 


A low signal rate is notable in itself, because it 
leads us into the field of theory concerning arousal and 


vigilance as a functicn of Stimuli. Miller and Wackie Iist 


wo ee. three critically tmpertant characterrstresmse: 
Stinuli used in experiments on vigilance that af 
perfcrmance, namely the background event rate_ (8 
aE as probability, and signal complexity." [ Ref. 1 


These topics will be dealt with in the following paragraphs. 
a. Background Event Rate 


The authors conclude that all reviewed exferi- 
Ments used high or extremely high BERs compared tec ofera- 
tional settings, making generalization difficult. But, they 
State, vigilance tkeories concur in predicting that low 
rkackground event and signal rates will lower the monitcring 
load, and hence tte levels of arousal and expectancy, 


resulting in greater deterioration of performance. 
b. Signal Prebability 


A well established result of vigilance testing 
is that signal probability, i.e. the ratio of Signal ctatemee 
kackground event rate, is directly related to the frob- 
ability of detection itself. Thus, a low signal probability 
will lead to areduced detection probability. Lt (ke 
suggested that the signal probability in a vigilance exferi- 
ment should be as low as in comparable operational settings 
if the experimenter wishes to be able to generalize his 
results to that envircnment. One question that has not been 


dealt with is whether an experiment in which signal 


14 


cccurrences are nearly as probable as background events 
(i.e. a thigh't signal probability), but the background event 
rate is very low itself, Can be classified under high 
signal probability and included in the mentioned doults 
about its validity. 


Ce oronat sc OnpIex1ty 


Signal ccmplexity stands for the dimensionality, 
duraticn, pattern, and seguence of signals. Dimensionality, 
jee. the difference in representation (code) and location of 
symbols on the display, is found to have a negative effect 
cn performance if it increases [Ref. 1]. An extensive, or 
repetitive duration of the signal, iike, e.g., in the ofera- 
tional environment of a radar monitoring task, apparently 
shifts the emphasis cf the operator's perception of the task 
from detection of signals to reacton time [Ref. 13], 
[Ref. 14]. 

Signal pattern and sequence describe spatial and 
temporal relation of Signals to background events. A signal 
that changes the diszflay by being added to a previous symtol 
pattern of other signals and background events in a contin- 
uouS presentation is defined as "Simultaneous". Such a 
Signal cccurrence is considered to be comparable to those in 
operational settings, especially monitoring. The reaction 
to signals presented like that may develop into what Wiener 
fRef. 15] calls “inferential monitoring", essentially a 
continuous 'no sSignal'-hypothesis testing by the individual 
operator [Ref. 1:3 p. z4}. 


ds Signal Regularity 


In addition to the factors described akove, 
temporal and spatial uncertainty, e.g. total randomizaticn, 
of signal occurrences on the display are found to havea 
negative, possibly even additive influence on reaction 


times, the latter on reaction accuracy as well [Ref. 16]. 


ee 


e€. Display Lensity 


Display density 1s a synonym for tne total 
number of symbcls on display when a signal is presented. 
The term ‘signal density' refers to the number of signals 
among them. Generally, increasing display density is 
expected to affect reaction times adversely [Ref. 17], with 
strong evidence that the use of colour codes reduces this 
effect considerably [Ref. 17], [Ref. 18]. It must be empha- 
sized, however, that the experiments referred to did nct use 


a Simultaneous Signal presentation. 


BE. SIGNAL DISPLAY 


1. Coding Mechanisms and Different Tasks 


Additional ccding on radar displays was intrcduced 
to enable operators to cope with the increasing workload 
placed on them by mcdern information systems. The three 
Major coding modalities are alphanumeric, shape, and colour. 
The gcal of improving efficiency, measured in reaction time 
and number of errors, was tested in numerous exreriments. 
However, they are far from unanimous in their findings about 
the superiority of a particular code. 

The positive cr negative effect of a coding mecha- 
nism iS inseparably related to the task it is used in 
[Ref. 19]. For vigilance experiments using visual displays 
those tasks have been mostly search and identification. en) 
a search task the sukject knows the type of signal te expect 
and has to locate it cn the screen. For identification the 
Signal type is not kncwn in advance and the task is to find 
a target and identify the category to which it belongs. 

In 1975, Christ [Ref. 20] came to the follcwing 
conclusicns in his extensive literature research cn cclour 
Coding. 
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is) Neon—-Ecdumdant colour im a search task 1S superior 
to all other codes ry a wide margin, in an identification 
task to mest others except alphanumeric coding. 

2. The effects of redundant colours in an identifi- 
cation task are still undetermined, with one experiment in 
favour, Cn Colour Goding [ Ref. 21}. 

The more recent publications of Wagner [Ref. 22] and 
Christ [Ref. 17] are much more cautious in establishing an 
order and do not suggest a Superiority for any particular 
code. During the same tine, Oda [ Ref. 23], Carter 
{Ref. 18], Kopala [Ref. 24], Noble and Sanders [Ref. 25], 
and Luder and Barber [Ref. 26] all reported significant 
improvements in perfcrmance of a search task using redundant 
Colloum coding. It must be emphasized, however, that thcse 
last experiments included multiple tasks and, in most cases, 
extremely high worklicads. A widely used, more technically 


oriented reference [ Ref. 27] states that 


GleorecOding will be helpful, if 
The display.is unformatted, 
Symbol denSity is high, ; 
Operator must search for relevant information, 
Symbol legikility is_ degraded, and 
Color code is logically related to . 
perator's task." [Ref. 273 p. 44] 


o1ritita 


Fut admits that colour coding pay have a negative effect on 
the symbol identification time. In the case of redundant 


codes, the same authcrs suggest to 


"w eee6CCUuse)6| 6ofully redundant. coding to improve symtol 
pongecoee* S and to aid in discriminating among symbcls 
Shere. 2/3 p. 79], 


and they report the ccmbination colour/shape to be the most 


efficient. 


Ne? 


a. Dimensionality 


An accerted result of colour research 1s the 
limitation in the numter of different colours for identifi- 
cation tasks. The established maximum in operational appli- 
cations is four, although more colours may be used in cther 
tasks after extensive previous training without negative 
effects cn performance [Ref. 22], [ Ref. 27}. 


Ee. Light Characteristics 


Luminance, brightness, contrast, saturation, and 
wavelength separation are all found to be factors in the 
effects cf colour coding. Although low differences, i.e. 
weak signals, may be used for subliminal perception or ISD 
experiments [Ref. 12], hig heconteacst, Saturation , and 
wavelength sSeparaticn are reccmmended to enhance Search 


performance in monitoring tasks [Ref. 24 }, [Ref. 27}. 
Cees olae 


In additicn to the factors mentioned, symbol 
size is considered tc bea determinant in identification 
tasks using colour. Krebs [Ref. 27] suggests a mirizal 
symbol width of 20 te 45 minutes of arc as necessary for 
unimpaired visual identification, the size increasing 


linearly with the number of colours in use. 


C. EXPEFIMENTAL HYPCTHESES 


Frcem the previcusly presented research results we 
conclude the following : 

1. Human performance is liable to show severe decrements 
rketween 10 p.m. and 6 an. due to a low in diurnal rhythr. 


Those decrements will occur in addition to and later than 
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the decrements that have been observed in most vigilance 
Spotl omGdunEEngum tne Lirst 30 Minutes orf time on task. 
There is some evidence that this decrement may not be found 
in a pure monitoring task [Ref. 12]. 

2. There seems to be a strong case for the beneficial 
effects of redundant colour coding in complex tasks and 
under high workloads. However, there is no evidence to 
suggest similar effects in a Simple monitoring task of 
extended length. 

3. A very low signal probability, combined with temporal 
and spatial uncertainty of signal occurrences, is expected 
to have negative influence on both reaction time and accu- 
racy. It should be recalled that there is neither a theory 
HOnmdata Gencerning the combination of a ‘hight signal rrcb- 
ability with a low background event rate, and its rfossitle 


classification. 


Proceeding fron those conclusions, we expect the 


following results frem the present experiment: 


e Operator performance will show further decrements tnrough 
session duration after the first 30 minutes, documented 
by an increase in detection latency (= reaction time) and 
a decrease in reaction accuracy (= increase in number of 


SCEEOLRS) . 


e Operator performance will be enhanced by the use of 
redundant colour ccdiny, both in reaction time and accu- 
Lagi. 


e There will be an interaction between treatments ( rono- 
vse. multicnromatic ) and session duration. The applica- 
ticn cf the redundant colour coding mechanism is antici- 


pated to result in increasingly beneficial effects. 


Li 


Tite eno 
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A. OBJECTIVE 


The objective of this experiment was twofold, first, to 
collect data on operator performance ina simple monitoring 
task during an 8-hour night time interval, and second ,to 
search for possible positive effects by the additicr of 
redundant colour codes to a currently operational set of 


shape codes. 


Bo SUBJECTS 


2C subjects participated in the experiment, nineteen 
were military, one a Civilian. 18 subjects were male, two 
female. Subjects belcnged to four different nations, nanely 
Germany(2), Norway(1), Turkey(2), and United States (15). 
Pair matching was used for the 3 smaller groups of different 
gender and nationality. The age of the youngest subject was 
26 years, that of the oldest 42 years. The average age was 
32.35 years. The chosen subjects had previcus experience in 
working with displays containing coded informaticn. A 
learning effect during the experiment was assumed to be 
negligicle. 

No cases of deficiencies in colour vision were reported 
among sukjects, and sight anomalies were ruled out as necn- 
existing or corrected. None of the subjects reported 
medical treatment with drugs that might have impaired their 
abilities. All sukjects volunteered and most of then 
expressed genuine interest in the experiment. They could be 
described as nighly mretivated towards their task. 
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C. AFPARATOS 


1. Equipment 


The test device was located inside a scund- 
attenuating and Jlightproof experimental booth with the 
dimensions L = 6'2", W = 60", H = 615, A 
Hewlett-Packard HP 9845 C desk-top computer placed on a 30" 
high tatle was used for the Simulation display and the 
response input. The response keys were located on the 


keyboard as shown in figure 3.1. 





Dispiay Keys 
Edit System Command Keys Special Function Keys 
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Alphanumenc Keys 


Figure 3.1 Response Keys on the Keyboard. 


The subjects were seated onan office chair with 
height 20", the back resting against one wall of the booth. 
The yeripheral test devices ( clock and printer ) were 
located cutside of the booth. 
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Ze)  Synnoks 


The presented symbols were either monochromatic with 
white cclour, or mnultichromatic with colours Gea, green zwar 
blue as redundant codes, both against a black backgrcecund. 
The presentation of the symbols uséd in this experiment was 


as given in table 1. 


TABLE 1 
Shape and Redundant Colour Codes for Symbols 


— 


Symbol Aircraft | Surface Craft Colour 
Enemy IN © Red 

| Neutral iar (-) Green 
Friendly LN C) Blue 


él 


The symbols had a width of 0.65 cm and a height of 
0.40 ( aircraft ) or 0.65 cm ( surface craft ). Assuming an 
average distance of 75 cm between the observer's eye and the 
screen, the signals subtended a width of 25 minutes of arc, 
satisfying the technical requirements for a three-ccolcur 
display [Ref. 27]. 

The three-colcur combination of red, green, and blue 
was chosen as preferable to the normally used red-yellow- 
green for the following reasons :; 

1. The code red = eneny, green = neutral, blue = 
friendly is cemmonly used on coloured plots in the 
military services of NATO countries, and thus a 
*population stereotype for the participating 
subjects. The logic relation to the task was assumed 


to be strongest for that combination. 


ZZ 


Zz. AS the identificaton task requested reaction to 
enemy, i.e. red, signals only, a higher wavelength 
separation of that colour to the nearest one also in 
use (in this case, green instead of yellcw) was 
considered favourable [{Ref. 27] and less likely to 
induce errors cf commission. 


CT. FEROCEDURE 


1. Design 


There were two possible treatments in the experi- 
ment, both using the same shape coding mechaniSm against a 
Elack Eackcround, with an equal number of subjects in each 
treatment group. The ‘operational' treatment, henceforth 
referred to as the ccntrol condition, used white symcols, 
the experimental treatment, henceforth referred to as the 
experimental conditicn, used coloured symbols with the 
colours red, green, and blue as redundant codes. 

In each condition, six different symbols could be 
presented, of which two (tenemy') were defined as Signals, 
fours |" heutral’ and ‘friendly') aS background events. 
Appearance of a Signal reguired detection and discrimination 
Fetween the two possible signals (‘aircraft' or ‘surface 
craft'), i.e. a combined search- and identification task, 
and the appropriate manual reaction, which will be explained 
in detail below. 

The treatment that a subject received remained 
unchanged for the entire length of the experiment. Although 
the sequence and the inter-arrival time of the stimuli were 
randomized, the experiment was the same for each subject, 
except icr the condition differences, this being ensured by 
the use cf the same randomization procedures. The experi- 
ment was divided by Ereaks into four time segments of equal 
length and approximately equal workload, as defined by the 


number of signal occurrences in a segment. 
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The independent variatles were the conditicr and the 


time segment, 


during which 


g@eecal tle ula 


resulting in the experimental design given in table 2. 


—— a a 


Experimental Design 


Signal occurred, 


ee “ 


TABLE 2 


| 

segment J 2 3 E | 
Conditions | 
Contre Sub tect Subject Subject SUB jC CE | 
Condition Sia a0 Sis 0 Sse Ses 16 i 
Experimental Subject Subject Subject Sums ect | 
Coudic1von Saez 0 Sii—5Z0 §11-S20 cami > 20 | 


a SS a ee eee [SS SS ae OE EE ee 


Reaction time and accuracy, 1-¢e. number of errors, were the 


dependent variables. 


2. Preparation 


The first part of the subjects" preparation was a 
kriefing which took flace at least 6 hours before the exper- 
and the 


information about the shape codes, 


iment. It covered the motives for goal of the 


experiment, explanation 
of the display and sintulation andmans true. 
the task, 


within this chapter, without mentioning the different exper- 


of the symbols, 


tions akout as given inthe relevant sections 


imental conditions. 


The second fart was a short demonstration, 
the start of 


a self-paced display of the 


taking 


place 5 to 10 minutes before the experizent. 


It consisted of symbols in the 
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coding ccndition the subject was to receive, and a test run 


cr 60 seconds' length, including 2 signal occurrences. 


@Ep 2s = == SSE  - ae ee  E Zp =. a ae SS a ee ee ee EE ee 


Subjects entered the experimental laboratory at 9:45 
pen. te go through the preparatory demonstration. The 
experiment proper began at 10 p.m. and ended at 6 a.m. of 
the fcllcwing day. Except for breaks, the subjects remained 
in the experimental Lbooth. A break was scheduled every two 
hours for 15 minutes. Non-alcoholic beverages and snacks 
were cffered, and the subjects had time to visit the tath- 
room. Fefore and after the test and in every tzeak the 
subjects had to fill cut a guestionnaire referring to their 
self-estinated state and performance. The questicnnaires 


are given in appendices Ai - A3. 


4, Experiment 


a. Display 


The computer's CRT represented a tactical radar 
screen of dimensions 60 x 50 nm with precoded information 
cnly. A simulated situation could contain simultaneously up 
to four signals and seven symbols ( signals + background 
events ). A situaticn was displayed on the screen withcut 
change or interrupticn for an interval of 6 seconds. After 
cia ty symbol positicns were updated according to their 
previously determined movements ( that could mean disaffear- 
ance of the signal/symbol, if the new position was outside 
the screen boundaries ), a new signal/symbol could be added 
( see below ), and the new situation was displayed again. 
An ‘own-ship' symbol remained in the center of the screen 
throughcut the test. Three typical situations at signal 
entry are given in afrendices Bi - B3. 


Fae 


ke. Simulaticn 


Symbol characteristics were created randonly 
with five different random draws ; 
1. Symbol identity (enemy, neutral, or friendly), using a 
uniform distribution with the probabilities p(enemy) = 
0.4, F(neutral) = 0.3, and p(friendly) = 0.3 


Ze Symbol type {aircraft OF SUEEacCe craft) > using. nc core 
tional probabilities p(aircraft I eneny) =" 0.625% 
p(aircraft I neutral) me) O67 and wo ({airerart 
friendly) = 0.667. 


3. Speed, based on type, could vary uniformly between 400 
and 600 knots for aircraft and 12 and 36 knots for 


surface craft. 


-— 
e 
ite 


ntry Point. First occurrence on the screen was possikle 
only on its boundaries with equal probability for all 


pcints. 


5. Course. Dependent on the side of the screen on which the 
entry occurred, astimulust course could vary unifornly 
through the semicircle extending towards the center of 
the screen, e.g. for an entry from™tne "Dotton" fron 
"left' ( = 270 degrees ) over tup' ( = 360 degrees ) to 
'right' (= 90 degrees ). 


Speed, entry point, and course were the factors deciding 
how lcng, i.e. in how many 6-Seconds-iterations, a symbol 
was displayed on the screen. For aircraft, that time varied 
between one and three minutes, for surface craft, between 5 
and 63 minutes. 


A sixth random draw at the beginning of each 6-seconds 
display interval determined whether the entry of a new stia- 


ulus took place or net. The probability of a new entry was 
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0.02, setting the expected time interval between entries at 
5 minutes. An experiment included presentation cf 33 
signals, distributed with 8, 9, 7, and 9 occurrences in the 
four time intervals, and 59 background events, distrituted 


Mchezoe lO, Co, ananlo occurrences, 92 Stimpull in all. 
Cre ask 


Subjects were reguired to respond to the aprear- 
ance of a signal on the CRT by pressing one button in one of 
two specified columns on the keyboard, discriminating 
between the two possible signals by chosing the respective 
column associated with that signal. They received no feed- 
krack as to the accuracy of their discrimination or respense. 
The program used in the experiment was designed to reccrd 
only the first reaction ona new target and to disregard 
further corrective cr inadvertent input. 

Uvem@ieemeted POSTtLION “Indicator, e.g. a light 
pen or a marker on the CRT, to associate a reaction with a 
particular signal that had occurred, was considered tec be a 
confounding factor with respect to reaction time in a vigi- 
lance task, and was therefore excluded from the experiment. 
Without such an indicator, the recorded reactions could only 
ke attrikuted to the symbol which had appeared most recently 


on the screen. 


ecu perviston 


The program caused the printer to print a warning 
message in the situation that a subject missed a signal in 
the first interval cf appearance, i.e. for 6 seconds. aes 


was interpreted as a possible indication that the subject 


had fallen asleep. The experimenter remained in the test 
room, tut outside the booth, for the full length of the 
experiment. He entered the booth only, if alarmed by the 


printed warning message, 30 seconds after the warning. 
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6. Recording 


Reaction time and accuracy were recorded automati- 
cally by the progran. At the end of the experiment the 
records were transferred to a magnetic tape data file for 


further use and printed in hard copy for an immediate check. 
ae Reaction Time 


Reaction time was recorded with an accuracy of 


1/10 cf a second. 
ke. Errors 


The following errors were recorded 

e Error ci Omission. The subject did not react 
to a Signal until the next stimulus appeared. 
This caused a check of the subject in the 


booth Ey the experimenter. 


e Error Of Discrimmaviron. The subject reacted 


to the appearance of a signai, but identiried 


it inecrrective 


e Error of Commission. The subject reacted toa 
non-signal stimulus by pressing a response 
button (*False Alarm"). 


c. Recording Device 


As the response buttons were sensitive to the 
lightest touch, there were freguent recordings of inadver- 
tent input after appearance of a non-Signal stimulus. ‘Those 
were easily recognized by their excessive reaction times of, 
e.g., 7/7 seconds. There was no ambiguous case, which migat 


have keen interpretatle as an error of commission. 
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Ae ERRORS 


The main characteristic of the error data was the 
performance of a few ‘bad watchkeepers' and the hich number 
of misses in the experimental condition. Errors are listed 
PeEweoULacecmmrn atpeneices Ci and C2. Summed up, the distri- 
Lution cf errors was aS jiven in table 3. 


TABLE 3 


| 
| : : P a, 
| Distributicn of Errors over Conditions 





jae afe sal Ommission Discrimination Commission 
Centrcl 1 3 5 

| Experiment 11 Z 5 

ye yp a a Ee 2 g p J 





In view of the many ties in the data a nonparametric 
rank test seemed the rest choice to test the null hypothesis 
tite 


~ both conditions will have the same effects on the numker 


cf errors. 


The null hypothesis was tested separately for each of 
the three possible types of error. The Marn-Whitney-test 
[Ref. 28: p. 216 f£.] was selected as the most apprcpriate. 
In the following description of test results, X is used as 


index for data of the control condition, Y as index for the 
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experimental conditicn. The test results for the different 


types of errors were as follows : 


Errors of Ommissicn. The ranksums were R(X) = 83.5 and 
R({Y) = 126.5, hence R(Y) was selected for the test. fhe 
null hypothesis was rejected, with a Ti-value of 2.008, 
Significant at the 0.02-level. 


Frrors in the experimental condition were distrituted 
with 1, 4, 3, and 3 cccurrences over the four time 
intervals. Analysis by situations, i.e. by format and 
density of the display at the time of signal appearance 
and ky the preceding interarrival time, did not indicate 
influences by spatial signal uncertainty, degrees of 
display density, or different preceding interarrival 
times of signals cr background events. 


EIrOIs Of WUi1ser tana rene The ranksums were R(X) = 
19.5, “Rega = 100.5, R(X) was selected. The null 
hypothesis was accepted at the Q.25-level with a 


Ti-value of 0.548. 


ommission. The ranksums were R(X) = $2.5, 
117.5, cespectively; R(Y) was selected for 
the test. The null hypothesis was accepted at the 
O.i-level with a Ti-value of 1.131. 


Errors in the experimental condition occurred in the 


first time interval cnly, in the control condition they were 


distributed with 2, 0, 2, and 1 over the time intervals. 


BE. 


REACTION TIME 
1. General 


The recorded reaction times are shown in figure 4.1 


and figure 4.2 on the next page. 
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REACTION TIME IN SECONDS 
Figure 4.1 Histogram of Reaction Times. 


REACTION TIME IN SECONDS 


Figure 4.2 





SESSION TIME IN MINUTES | 


Distribution of Reaction Times over Duration. 
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An ingpection of the data gave reason to perform an outlier 
test. This led to the exclusion of all reaction times beyond 
10.75 seconds, in all, 9 data points out of 660, from the 
analysis. The result was a reduction in variance from that 
cf the ccmplete data set to that used in the analysis Ly 65 


percent. 
2. Analysis of Variance for Time and Coniition 


The data were ordered in a 2x4 block design as Shown 
in table 2 in the previous chapter. The test used for the 
analysis was the ‘Analysis-of<Variance test for factorial 
experiments’, as given in Winer [Ref. 29: p. 228ff.]. 

The validity of the assumption of homogeneity for 
all variances was established [Ty performing two tests reccn- 
mended bry the same author. Both Hartley's (F-max-) test 
with F = 3.2901 and Cochran's test with C = 0.2227 showed 
the differences between variances to be not Significant at 
the 0.1-level ( see Appendix D). 

The results of the analySis of variance are shcwn 
in table 4. The level of significance is 0.05, if noe 
stated explicitly otkerwise. 

Therefore time was accepted as having an effect on 
performance with sigrificance at the 0.001-level. A comru- 
tation of trend compcnents [{Ref. 29:3 p.- 273£.]j] showed the 
Main trend to be linear ( see figure 4.3 ) with SSlin = 
3.573, or 69 % of the total main effect. 


There was nec Significant difference in the effects 
ef the ccntrol and experimental conditions. 

The interacticn between time and conditions was not 
Significant. Although figure 4.3 seems to indicate a certain 
Change of trend between conditions in the last two inter- 
vals, a Newman-Keuls multiple range test [Ref. 29: p. 80] 


Showed that change tc be not significant. 


32 





TABLE 4 
ANOVA for Time and Condition 


Source dF SS MS Eee.) 


Tize 3. 1766 lee 26 9.4497 
Condition 1 0.0274 0.0274 0.1498 
Time x Condition 3 0.8474 Ueezo2 1.5469 
Sukjects 18 Zoo leezO22 6.5505 
PEroOr 54 9.8609 GO. VS26 

Total 79 SIs Do20 


J 


ge RE Ee 


CONTROL (0) AND EXPERIMENTAL (¢) CONDITION 


MeAN REACTION TIMES IN SECONDS 





1 2 2 4 
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Pigure 4.3 Cell Means of Tise Segments and Conditions. 


Differences between subjects were significant beyond 
the 0.001-level. 


Bo 


3. Effects of Signal Occurrence Situations 





As for the errors, an analysis of reaction times by 
display characteristics at the time of signal appearance was 
performed. There was no evidence for negative effects by 
temporal or spatial uncertainty of signal occurrences. for 
density, however, expressed either in the number of signals 
( figure 4.4) or the total number of symbols ( figure 4.5 ) 
on display, inspecticn of the data in graphical representa- 
tion showed that both had a recognizable effect over tine 
segments, leading to statistical analysis in both cases. 
The tests used for the analysis of time and conditions 
(Ref. 29] were applied again. 


a. Analysis of Signal Density versus Conditions 
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Figure 4.4 Effects of Signal Density over Conditions. 


The possikle number of signals on display ranged 


from one to four, the 33 situations of signal occurrence 
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G@astributedawithetrequencies of 15/1, ineeeewo/3, and 2/4 
ever the different densities. The 2x4 block design used was 
Similar to that used in the first analysis ( see table 2 ), 
the main factors now Lteing signal density and condition. It 
should be emphasized, however, that the analysis in this 
case was based on an unegual number of data points for the 
different ‘density'-blocks ( see above ). 

The differences Fetween cell variances were 
found to be not significant at the 0.10-level with a F-max 
Oueseueo7 dic ssdwecochran's C o£ 021798 ( See Appendix E ). 
The results of the analysis are shown in table 5. 


| TABLE 5 | 
| ANOVA for Signal Density and Condition | 
| Source GF 33 MS F (obt.) | 
{| Signal Density 3 bed 1.4009 S25 707m 
| Condition 1 9.0015 G2 0015 0.0093 | 
Sole x cCOngd 1 taon 3 0.7048 0.2349 124383 
Subdects 18 22-3089 1.2394 Veaoot | 
EEEOr aa 8.8200 0. 1633 | 
Teta. 79 36.0379 | 
} 


| 
| 
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Signal density was found to have a main effect 
on reaction time, significant beyond the 0.001-level, but 
Without a significant linear trend. 


The difference in the effects of the conditions 


waS insignificant and, actually, Statistically hardly 
detectable. There waS no Significant interaction between 
the twe factors. Tifferences between subjects were again 


Hrgn yesaguiticant. 
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tk. Analysis cf Display Density versus Conditions 
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Figure 4.5 Effects of Disrlay Density over Conditions. 


Due to the fact that only a few Signals occurred 
in ‘hight ( 5-7 symbcls ) display density, five blocks were 
used for the seven different densities. The first Fiows 
blocks contain the data points with corresponding display 
densities of one thrceugh four symbols, tne £iftth Eloek 
contains all data pceints of ‘hight density ( see above ). 
With that adjustment, the distribution of the 33 situations 
of signal occurrence was 4/1, 7/2, 6/3, 8/4, and 8/5+ over 
display density, mcre egual than in the case of sigral 
density. Due to the different number of blocks, al zie 
design was used for the analysis in this case, the main 
factors reing display density and condition. 

Again, the tests for homogeneity of cell vari- 
ances showed no significant differences with a F-max of 
3-4428 and a Cochran's C of 0.1587 ( see Appendix F ). 
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The results of the analysis of variance were as 


given in table 6. 


| TABLE 6 
ANOVA for Display Density and Condition | 

| SQurcE dF SS US F(obt.) | 
| Diszrlay Density 4 hie 7 428 Zee or 29.5 1438 | 
Conaition 1 Os0i 17 Os O47 Cee ied | 

| Detlese se Cond 1 tion 4 0.4015 0.1004 0.9771 | 
Sukjects 18 26.9489 1.4972 14.5750 jf 

| Error 72 ae 96.0 Cea 27 | 
ieetotal 99 UOa 327 
ll 


Display density was found to have a significant 
effect on reaction time with p << 0.001. Comparison of 
trend ccmponents showed a strong linearity with SSlin = 
10.72 ( = 90 % ), the linear and quadratic trend together 
accounting for 99.6 % of the total sum of squares. 

Conditions had no significant effect on reaction 
time. There was no significant interaction between the main 
EAGTOLS . Differences between subjects were highly signifi- 
cant keycnd the 0.005-level. 


C. QUESTIONNAIRES 


All sukjects resrended to the questionnaire, one set of 
answers (S 11) was lost. 

Nearly all subjects had had an average workload on the 
day they participated in the experiment, most of them with 
the expectation to werk again the next day. 
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All subjects referted a decline of at least one grade 
over time in the self-estimation of their performance. 

The reperted patterns of sleep/drowsiness and impaired 
visicn were, except fcr. one case, exactly the same for both 
conditions. 

Althcugh nearly all "subjects from tne Control @orcu- 
complained about the brightness of the symbols in their 
comments, none of the experimental group did. 

All subjects, however, did complain about the heat and 
the kEad air in the experimental booth in the free-style 
comments which were asked for in the last guestionnaire. 

All subjects estimated the breaks to have positive 
effects, but less so from break to break. 

Both groups reported approximately egual operatcr worx- 
loads for the same time segmentS with a sharp increase in 
perceived load in the last segment. 

A marked difference was found only inthe subjects! 
answer to the gquesticn which situation, i.e. signal afrear- 
ance in the Simultaneous display pattern, they had perceived 
as the most difficult to react tos. Thissis shown aun taneew 

Althcugh none of the subjects admitted difficulties in 
reacticn or discrimination in the explicit guestionnaire 
part, three of the participants in the experinental condi- 
tion reported a detrimental effect on detection carahbility 
in the ccmments. They attributed this to an error that they 
Called ‘target fixaticn' and described as a disturbation of 
a normal menitoring pattern by focusing on and unconscicusly 
devoting attention to signals already present on the screen 
before a particular signal appeared. 


210 


| 


| 

TABLE 7 | 

Subject Evaluation of most difficult Situation | 

ituation on Screen Conerol Experiment 

nd Signal occurrence Group Group | 

; ; 

ingle Signal (on clear screen) > 11 | 
added to N-S ( ne other §S ) 10 2 

added to other S and N-S Zo Ze | 

| 
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= Signal , N-S = non-Signal (background event) 
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Ve. DISCUSSION 


= ae See SSE 


A. EVALUATION OF RESULTS 


i. FLLOrS 


The most prcminent result was the high number of 
missed signals in the experimental condition. It should be 
noted that the number of ommissions 1S not attrikutable to 
cne or two bad perfcrmers; 50 % of the subjects in the 
experimental conditicn missed at least one target (_ see 


figure 5.1 ). 


CONTROL CONDITION 


REACHION TIME IN SEC. 





a RE ER RS RE: a RE ED aR E ED a 


Figure 5.1 Resronse Surface (Plateau = Omission). 


There iS Lo cComparakle evidence from other experiments 


dealing with monitoring tasks that substantiate this result. 
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Wit tewtRemmrcauundant Colour Codecs of the* backcround 
events had a well-defined logic relation to the respective 
Shape-coded symbols, they might be considered irrelevant, as 
there was no demand cn the subject to discriminate between 
them. This can, however, hardly be used as an explanation 
for the number of cmmissions. All available research 
results [Ref. 26] point to the conclusion that irrelevant 
colour coding has a negative effect on the processing of 
achromatic coded infcrmation, probably due to the different 
(parallel vs. serial) human processing mechanisms for those 
codes. Detection in the experimental condition, however, 
required processing cf chromatic coded information. 

The only apflicable information are the questicn- 
Raire ccrments about 'target fixation' in the experimental 
condition. Although the description of this erroneous behav- 
iour sounds logical and seems to appeal to ‘common sense’, 
it 1s not supported Ey the comparison of reaction times of 
selected situations with signal appearances spatially either 
very close to or very far from already displayed signals. 
It could be hypothesized, however, that’in this context an 
fold' signal's redundant colour (red) was not only irrele- 
vant, but distracting, as it gave an fattention'- specifica- 
tion to something that had been dealt with already from the 
aspect of the response task. 

Cccurrences cf either of the two other types of 
eCIror were neither significantly different over the two 
conditiors nor unexpectedly high. The temporal distribution 
of errcrs of commission does not indicate an increase over 
time, as would be expected from field experiments with 
comparakle time frames [Ref. 3], [Ref. 4]. On the contrary, 
there seems to be a fessible ‘learning effect’ in the exper- 


lmental condition. 
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2. Reaction Times 


Although some subjects showed the expected vigilance 
decrements cf the first 30 minutes, there was no overail 
significance. The effect of duration on reaction time was 
significant, but lower than expected from results of inves- 
tigations dealing with the same time frame. 

The experimental condition did not show the expected 
positive influence versus the control condition. Alttough 
the relation in the last interval is perceptibly different 
from the others, data are too few to support establishing a 
hypothesis about a negative trend in the control condition. 
The turnaround of the difference in that interval may have 
keen caused by increasingly higher eye fatigue in the 
contrcl condition, indicated Ly the general complaint abcut 
the high Erightness of the display in the correspcnding 
group of subjects. 

The absence cf differences between the wean reaction 
times of the two conditions, against our expectatiors kased 
on the results of Oda [Ref. 23] and Kopala [Ref. 24], might 
ke explained by expanding on the previously mentioned arau- 
ment cf irrelevant cclours. The second part of the task was 
discrimination, i.e. reaction to a shape-coded infcrmaticn, 
and reaction time in the experimental condition may have 
suffered from the detrimental effect of irrelevancies in the 
redundant colour coding mecharism. The fact that all recent 
experiments reporting beneficial effects of redundant cclcur 
coding used a high or very high operator workload, and the 
contrast of their results with the one presented above raise 
serious guestions akcut the generalizability of the fcrmer 
to an tunderload'-situation. 

The significant effects of both signal and display 
density are unexpected at this relatively low level of 


density, as comparable effects have been observed only far 
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above [{Ref. 18] or, in one experiment with simultaneous 
Signal appearances [fef. 30], at a density level of 16 
symbols. This points again to the concern about generaliz- 


ability cf other results towards low workload experiments. 


B. QOFERATIONAL IMPLICATIONS 


From the point of view expressed in the initial ofera- 
tional setting, two results seem to be important. 

1. The use of redundant colour codes does not result in 
a significant improvement of performance, i.6é., ane toils 
case, reduction of decrement. On the other hand, the high 
humber of ommissional errors raises serious questions about 
hidden disadvantages. The importance cf that result cannot 
be expressed in its statistical significance only. An ofera- 
tional estimate would attribute a much higher value to an 
error of ommissicn than to either of the other two tyres of 
error. A missed reaction in 3.3 % of all cases of target 
appearances would be unacceptable in all operational mission 
scenarios. 

2. Although time, i-ew task duration, was found to have 
a Significant effect on reaction time, there was no evidence 
for a definite 'low' in operator performance, the decrement 
Eeing much more linear over time than initially expected, 
and the average reaction times would be acceptable in an 
operational environment with an up-to-date hostiie threat. 
This result is reassuring in view of the initially expressed 
concern about lows or gaps in operator performance under the 


time constraints used in this experiment. 


The *underload'-ccondition must be considered as necrmal in 
Quceee ation wlth pre-conflict or conflict environments at 
sea for approximately 95 % of the time, and it deserves 


corresponding attenticn in further design. 
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The case made for the influences of irrelevant cclcur 
does, of course, not apply in the operational setting. fhe 
difference between neutral and friendly forces is guite 
relevant, and a hostile craft represents a threat and has to 


ke watched as long as it is on display. 


Last, rut not least, the guestion about the validity of 
this experiment, influenced by its deviations from the fieceid 


setting, deserves a mcre explicit answer. 


C. LIMITATIONS OF THE EXPERIMENT 


1. Environment 


A zajor goal of this experiment was to achieve a 
high degree of validity for operational concepts ty the 
duration of the experimental session and the seclusicn of 
the subjects. The cperational environment of a shifts CIC 
could, of course, not be totally duplicated. 

The subjects" general complaint about heat stress 
and sleepiness due tc bad air in the booth shows that at 
least scme environmental stress came to bear. In the case of 
heat, however, the influence may have been enhancing rather 
than detrimental [Ref. 31}. Lack of oxygen is probakly not 
a factor in modern, air conditioned shipborne CIiCs. 

Other environmental stress factors of work aboard a 
Ship like motion, noise, and vibration could, however, not 
be simulated due to limitations in equipment. From the 
author's own experience, moticn sickness must be considered 
aS a Majcr concern on small units, especially in prolcnged 
monitoring tasks in a CIC environment. Strong high-freguency 
vibraticns, normally very distinct aboard FPB's due to the 
high ratio of engine space in relation to the size of the 
roat, can be a factcr with ambiguous influences, too, as 
vibrations can arouse a subject's attention as well as they 


can put him to sleep. 


44 


Seclusion in the experimental bcoth was chosen, 
among other reasons, to keep the ‘reinforcement by presence 
of a supervisor or, in this case, his absence, egual for ail 
Slpgece os indt sSttWdtwen 2s NOtetypical [Cor an oferator's 
work in <a CIC; which is rcutinely supervised by his 


superiors. 
2. Sample 


The subjects cf both groups were taken from avery 
special population. The students attending courses at the 
Naval Postgraduate School have passed rigorous training and 
selection in their previous careers. They represent - and 
probakly consider themselves - an elite among their peers, 
and they are highly motivated towards both their present 
academic and future military tasks. A more ‘normal't pepula- 
tion might present greater difficulties in motivation due to 
less prefessional attitude, ability to imagine a comkat 


threat situation, and personal initiative. 


3. Experiment 





The desk-tofr computer used in the experiment has 
features rather different from those of a surveillance radar 
console. The screen is very small in comparison to that of 
a surveillance radar, and the response keys were neither 
labeled nor illuminated, as they are in the operational 
Sevuinc,me. Gc. a CIC. The small size of the screen, on the 
other hand, prevented confounding errors due to a human's 
weakness in peripheral colour perception, especially for 
red. Lack of technical feedback, like the indicatcr for 
target acquisition cna radar screen, was another factor 


reducing the subjects' reinforcement. 
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D. RECCMMENDATIONS FCR FURTHER RESEARCH 


It must be emphasized that this experiment deait only 
with one of a multitude of possible sets of alternate ccndi- 
tions. The answers and comments of the questionnaire are 
one of the main sources to proceed to the rational devéiop- 
ment cf new experiments. 

In the case of the control condition, i.e a MONCEehros 
matic display, there are two definite paths visible. The 
first deals with different, non-white colours, which can be 
€valuated with respect to their power of arousal and, on the 
other hand, its effects oneye fatigue, a Still oren 
research topic itself. The other involves experimenting with 
the infirite spectrum of light characteristics, e.g. brighkt- 
ness and saturation of colour, with similar goals. 

For the experizental condition, the multichrematic 
display, there remains the unsolved guestion about the high 
number of errors. This problem should be examined and its 
presence verified. Using the only hint available from scne 
guesticnnaires, the phenomenon of “target fixation*, “or 
known under these circumstances, should be reviewed. Two 
applicable types of experiment can involve breaking the 
attention devoted tc the monitoring by either seccndary 
tasks, or Ly artificial stimu. 

Common to both conditions was the very low cpferator 
workicad. Although there is growing concern about investi- 
gating the ‘tunderload'-situation, most experimenters seem to 
prefer test conditicns with high or maximal werkicads, 
combining a larger number of analyzable responses with a 
shorter task duration. The results of this experiment 
emphasize the concern that the effects of low werkloads 


deserve more attenticn and research efforts. 
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APPENDIX A 
QUESTIONNAIRES 


aire Underline right answers 


‘1. When did you get up today ? : 


2. Did you have a nap today ? Yes No 


and, if yes, when ? : 


3. Which of the normal meals did you have today ? 


Preakfast Lunch Dinner 
4. How many hours did you work today ? _. &rs 
Seek eOldmyou StoOpeworkKing today ? $:  _ 
6. When do you expect to start work tomorrow ? ____ ents 


7. Hew would you describe your workload for today ? 


Very High High Mediun Low Very Low 


8. How is your expected workload for tomorrow ? 


Very High High Medium Low Very Low 
9. Do you expect to start a major task tomorrow ? Yes No 


10. How would you rate your present mood ? 


( 5 = excited --- 1 = indifferent ) 


47 


Break Questionnaire Underline right answers 


1. How weuld you rate your performance in the last 2 hours ? 


Good Above Average Cake: Below Average POOL 


2. What did you feel in your performance during the last 2 


hours ? 
Improvement Nc change Decline 


3. Did you feel sleepy or drowsy during the last 2 hours ? 


Yes No 


4. Did you have mecnents of impaired ( blurred ) vision 


during the last 2 hours ? Yes No 


S- How would you rate the ‘operator workload! in the last 2 


hours ? Very High High Mediun Low Very Low 


6. Which situation was most difficult to react on ? 
- Target appearance on empty screen after waiting 
- Target appearance on screen with other non-targets 


- Target appearance on Screen with cther targets 


7. x#How do you feel now compared with the time before the 


last 2 hceurs ? 


8. How would you rate the effect of the last break on your 
performance afterwards, i.e. in the last 2 hours ? 

( does not apply in the first break ) 

Very positive Positive No effect Negative Very 


Negative 


9. How would you rate your present mood ? 


( 5 = excited --- 1 = indifferent ) 
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LOSt a eeomeo west Onna iis Poder tl Sec memaiawers 


=r SS = = 2 ea a eee 


i. Hew cdouyou feel wren. @ 


Fully Awake Awake In Between Tired Very Tired 


Z-ileweweula yOu eStmiate your ability to drive a car ? 


Very Good Good Pcie FOoOr Very Poor 


3. How would you rate your mood ? _ 


( 5 = excited --- 1 = indifferent ) 


4. How would you rate the target coding mechanisn ? 


Very Good Good Medium POOL Very Poor 


S. Did you have difficulties in discriminating target iden- 


tities ( Hostile, Neutral, Friendly ) ? Yes No 


6. Did you have difficulties in discriminating target types 


( surface craft, aircraft ) ? Yes No 


7. Did you have difficulties with the location of the reac- 


tion keys ? Yes No 
€. Comments on the other side, please 


Thank You !!! 
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ATIONS 


A. Signal Appearance on Clear Screen 
(circle indicates signal that just appeared) 
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/ 
a 


50 


EB. Signal Appearance cn Screen with other Non-Signals 


(circle indicates signal that just appeared) 
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C. Signal Appearance on Screen with other Signals 
(circle indicates Signal that just appeared) 
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APPENDIX C 
DISTRIBUTION OF REACTION ERRORS OVER SUBJECTS 


Si 0 0 0 
Sez Q 0 0 
So 0 0 0 
Ss 4 0 ZZ 4 
Sx5 1 0 0 
Sao 0 0 1 
s 7 0 0 0 
Seo C 1 0 


tn 
Oo 
© 
© 
© 


Sun 1 3 5 


aS 


Sala 4 0 1 
S12 Z 0 1 
Sais 0 0 1 
Ss 14 C 0 0 
Sa 1 0 0 
Sto 0 0 1 
Ss 17 1 0 0 
Ss 18 C 0 1 
Sono & 2 0 


tun 
tho 
to 
Io 
I> 
{Io 


Sum 11 2 5 


54 


APPENDIX D 
BOXPLOT OF CELL VARIANCES FOR ANOVA 1 


CONTROL CONDITION 


REACTION TIME IN SECONDS 





MME SEGMENTS 1 THROUGH 4 


EXPERIMENTAL CONDITION 


REACTION TIME IN SECONDS 





TIME SEGMENTS 1 TRROUGH 4 


a5 


APPENDIX £ 
BOXPLOT OF CELL VARIANCES FOR ANOVA 2 
CONTROL CONDITION 


ve] . ee eo2@ee se & 68 =O 29 SESH MOMs ce Memeses © © * + G8 COD ameow oH 06% 6 CHF + OH He 10% DHSS BeSW® oo 


REACTION TMi IN SECONDS 





SIGNALS ON DISPLAY 


EXPERIMENTA! COND'TION 


REACTION TIME IN SECONDS © 





SIGNALS ON DISPLAY 
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APPENDIX P 
BOXPLOT OF CELL VARIANCES FOR ANOVA 3 


CONTROL CONDITION 


REACTION TIME IN SECONDS 





SYMBOLS ON DISPLAY ( 5 : 5 OR MORE )} 


EXPERIMENTAL COND:TION 


REACTION TIME JN SECONDS 





SYMBOLS ON DISPLAY (5: 5 OR MORE ) 
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